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§  1  Introduction 


Let  X  denote  a  random  variable  having  density  function 

me)  =  ^|0<.<»].  (1.1) 

where  a(x)  is  a  function  on  [0,  oo),  and  continuous,  positive  for  x  >  0,  A(9)  =  a(x)dx  < 
oo  for  every  6  >  0,  9  is  the  parameter,  which  is  distributed  according  to  an  unknown 
prior  distribution  G  on  [0,oo). 

We  consider  the  problem  of  testing  the  hypotheses  Hq  \  9  <  9q  verses  H\  :  9  >  0O, 
where  90  >  0,  is  a  known  constant. 

Let  a  =  i  be  the  action  in  favor  of  H{.  For  the  parameter  9  and  action  a,  we  use  the 


loss  function 

1(9,  a) 

=  a(90  -  9)I[6<e0]  +  (1  -  a)(9  -  6o)I[o>e0]- 

(1.2) 

Assume  that 

f  9dG(9 )  <  oo. 

(13) 

Define 

and 

*»«=/.  m*1®. 

By  Fubini  Theorem, 

rOO 

/  a(x)ac(x)dx  (1.4) 

Jo 

= 

roo  ro o  1 

L  a(x)L  A(e)dG(6)dx 

= 

r OO  roo  n( 

L  /» 

2 


(1.6) 


Let  W(x)  =  90ocg{x)  —  ^g{x)-  Using  (1.4)  and  (1.5),  we  have 

roo 

/  \W(x)\a(x)dx 
Jo 

roo 

<  /  [^oCxg(^)  +  'tpG{x)]a(x)dx  <  oo. 

Jo 


A  test  5(x)  is  defined  to  be  a  measurable  mapping  from  (0,  oo)  into  [0,1]  so  that 
5(x)  =  P{  accepting  Hi\X  =  x},  i.e.,  5(x)  is  the  probability  of  accepting  Hi  when 
X  =  x  is  observed. 

Let  R(G,  <5)  denote  the  Bayes  risk  of  the  test  S  when  G  is  the  prior  distribution.  Then 
R(G,  S)  can  be  expressed  as 


roo  roo 

R(G,5)  =  Gg  + Jo  JQ  8(x)(90-9)f(x\9)dxdG(9) 

roo  roo  1 

=  Cg  +  L  d^L  ~  ^  J(0jdG(d)]a(x)dx 

roo 

=  CG+  6(x)[90aG(x)  -  ipG(x)]a(x)dx 

Jo 

roo 

=  Cg+  6(x)W  (x)a(x)dx 

Jo 

roo 

-  CG+  ^(x)[0o  -  (f>G{x)]ocG{x)a(x)dx , 

JO 


(1.7) 


where 


roo 

CG  =  Jo  (i 9-90)I[e>eo]dG(9 ), 


and 

fcW  =  B[e\x  =  x\  = 

aG\x) 

Here,  4>g{x)  is  the  posterior  mean  of  9  given  X  =  x.  ^g(x)  is  continuous  and  increasing 
in  x. 

Prom  (1.7),  we  see  that  a  Bayes  test  8q  is  determined  by 


8a(x) 


The  minimum  Bayes  risk  is 


1  if  W(x)  <  0 
0  if  W(x)  >  0 

1  if  <f>G(x)  >  9q 
0  if  <Pg{x)  <  9q. 


(1.8) 


roo 

R(G,  5g)  =  Cq  +  J  5G{x)W(x)a(x)dx. 


To  exclude  trivial  cases,  we  assume  that 


(1.9) 


^g(O)  <  #o 

G(90)  ±  1 
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(1.10) 


From  (1.10),  we  see  that  <Pg{x)  is  strictly  increasing  and  there  exists  a  unique  point 
ba  <  0q  such  that  ^g(^g)  =  #o-  4>g(x)  <  #o  for  x  <  &g>  and  <f>G{x)  >  &o  for  x  >  bo- 
Therefore,  the  Bayes  test  Sg  can  be  represented  as 


Sg(x) 


1  if  x  >  be 
0  if  x  <  be- 


We  assume  that,  for  some  constant  B  >  0, 

sup  |o£)(a;)|  <  B,  (1.11) 

O<a:<0o+1 

where  i  =  0, 1, •  •  *,r  and  r  >  1.  Note  that  (l.ll)  implies  that  G'(x)  exists  for  0  <  x  < 
^o  +  l.  Furthermore,  we  assume  that 


G\bG)  ±  0. 


(1.12) 


We  will  deal  with  this  testing  problem  via  the  empirical  Bayes  approach.  The  empir¬ 
ical  Bayes  approach  was  introduced  first  by  Robbins  (1956,  1964).  Let  Xi,X2,-  •  •  ,Xn 
denote  the  observations  from  n  independent  past  experiences.  Let  X  be  the  present  ob¬ 
servation.  Denote  Xn  =  (Xi,  X2,  •  •  • ,  Xn).  An  empirical  Bayes  test  Sn(X,  Xn)  is  defined 
to  be  the  probability  of  accepting  Hi  when _X  and  Xn  are  observed.  Let  R(G,Sn\Xn) 
denote  the  Bayes  risk  of  6n  conditioning  on  Xn  and  R(G,  6)  =  E[R(G,  5|An)]  the  overall 
(unconditional)  Bayes  risk  of  Sn. 

Since  R(G,Sg)  is  the  minimum  Bayes  risk,  R(G,  8n\Xn)  —  R(G,6g)  >  0  for  all  Xn 
and  for  all  n.  Thus,  the  regret  R(G,  Sg)  —  R(G,  Sc)  >  0  for  all  n.  The  nonnegative  regret 
R(G,  Sn)  —  R(G,  Sg)  is  often  used  as  a  measure  of  performance  of  the  empirical  Bayes 
test  of  Sn. 

Empirical  Bayes  problem  for  the  Uniform  (0, 6),  a  special  case  of  (1.1),  was  studied  by 
a  number  of  authors:  Fox  (1978),  Van  Houwelingen  (1987),  Nogami  (1988),  Liang  (1990) 
and  Karunamuni  (1999).  For  the  distribution  family  having  density  (1.1),  Gupta  and 
Hsiao  (1983)  considered  the  empirical  Bayes  rules  in  the  selection  problem  formulation, 
Datta  (1991)  studied  the  empirical  Bayes  rule  in  the  estimation  problem  formulation. 

In  this  paper,  we  consider  the  empirical  Bayes  rule  in  the  testing  problem  formulation. 

For  clarity,  we  consider  the  different  cases  of  a(x): 

Case  1  :  a(x)  — >  a0,  where  0  <  ao  <  oo,  as  x  l  0, 

Case  2  :  o(a;)  4-  0  as  x  1 0, 

Case  3  :  a(x)  t  oo  as  x  4-  0, 

Case  4  :  a(x)  — >  0  as  x  4-  0, 
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Case  5  :  a(x)  — >  oo  as  x  |  0, 

where  f  (  or  J, )  stands  for  “goes  to  increasingly”  (or  “goes  to  decreasingly” ,  respec¬ 
tively). 

Although  Case  2  is  the  special  case  of  Case  4  and  Case  3  is  the  special  case  of  Case 
5,  our  approach  (or  result)  is  a  little  different  between  Case  2  and  Case  4.  Also  our 
approach  is  different  between  Case  3  and  Case  5.  So  we  treat  Case  2  and  Case  3  as  the 
separate  cases. 

Define 

Qx  =  {G  :  G  satisfies  (1.10),  (1.11)  and  (1.12)}. 

For  some  £  >  0,  L  >  0  and  bo  >  0  in  Cases  2,  3,  4,  5,  &o  =  0  in  case  1,  define 

Gi  =  {G  :  G  satisfies  (1.10)  and  (1.11),  >  60,  min  \W\x)\>L\, 

x€NbG(() 

where  AT6g(£)  =  (i  :  0  V  (bo  —  £)  <  x  <  (bo  +  £)  A  0o}-  Then  we  can  construct  a  Bayes 
test  5n  such  that  its  regret  has  a  convergence  rate  of  order  0(n~'^+ r)  or  0(n~2rrre-1) 
(different  rates  in  different  cases)  for  any  G  G  Qx,  where  en  is  any  prespecified  (large) 
positive  sequence  such  that  en  — >  0  as  n  — f  oo.  And  we  can  also  construct  another 
empirical  Bayes  test  Sn  such  that  its  regret  has  a  uniform  convergence  rate  of  order 
0(n~ 2?+r )  over  the  class  Taking  a(x)  —  1,  we  would  get  that  supGeg2  R(G,  S)  — 

R(G,  S )  =  0(n"27+i))  which  is  a  result  obtained  by  Karunamuni  (1999).  But  we  exclude 
the  condition  that  bo  falls  in  some  known  interval  [0,  p0],  where  p0  <  0o  is  a  known 
constant. 

The  paper  is  organized  as  follows:  §1  gives  the  introduction;  §2  constructs  the  em¬ 
pirical  Bayes  test  Sn;  §3  proves  that  the  empirical  Bayes  test  has  a  good  asymptotic 
property.  §4  proves  the  lemmas  stated  in  §3. 


§  2  Construction  of  Empirical  Bayes  Tests 


We  use  the  kernel  method  to  construct  the  empirical  Bayes  tests.  Let  Ko(y)  be  a 
Borel-measurable,  bounded  function  vanishing  outside  the  interval  [0, 1]  such  that 


f  yjK0(y)dy 
J  0 


1  if  j  =  o, 

0  if  i  =  1,2, •  •  *,r  —  1, 


(2.1) 


and  let 

Kx(y)=  fy  K0(s)ds.  (2.2) 

J  0 

We  may  let  Bx  be  a  positive  constant  such  that  \K0(y)\  <  Bx  for  all  y  e  [0, 1].  Let  en 
be  any  (large)  positive  sequence  such  that  en  0.  Without  loss  of  generality,  assume 


5 


(■n  ^ 


logn ' 


Let  un  be  a  positive  sequence  such  that  un  <  1  and  un  — >■  0  as  n  — >•  oo.  For 


any  a:  G  (0,  oo),  define,  for  Case  1,  Case  2  and  Case  4, 


V»n(z)  =  —  I] 
and  for  Case  3  and  Case  5, 


nu  — 

r  / 


rx-X. 


Ko(^) 

<x,)  ’ 

(2,3,1) 

1  1  G 

nh  <XS)  ■ 

(2.3.2) 

*  *.(*=*) 

[  <Xj)  ’ 

(2.4.1) 

L)  ,  1  A  Kx(^) 
n  f£  a(Xs)  ■ 

(2.4.2) 

TllL  j—i 

Let  Wn(x)  =  60an(x)  —  ipn(x).  We  shall  show  later  that  Wn{x)  is  an  asymptotically 
unbiased  and  consistent  estimators  of  W (x)  (Lemma  3.1).  For  any  G  E  Q i,  we  propose 
an  empirical  Bayes  test  Sn(x,Xn)  by 


„  _  f  1  if  (x  >  60)  or  (dn  <  x  <  80  and  Wn(x)  <  0), 
n  |  0  if  (x  <  dn)  or  (dn  <  x  <  Oo  and  Wn(x)  >  0), 


(2.5) 


where 


0  for  Case  1, 

dn  =  <  maxfa; :  a(x)  <  rjn}  for  Case  2  and  Case  4  ,  (2.6) 

max{a;  :  a(x)  >  ^-,a(a:)  >  +  u  for  Case  3  and  Case  5  , 


2r  +  l 


and  r)n  =  en2r  .  Since  r)n  — »  0  as  n  — >  oo,  we  know  that  dn  — >  0  as  n  — >  oo.  Suppose  No 
is  the  smallest  positive  integer  such  that  bo  >  dNf).  Then  be  >  dn  for  n>  N0.  When  we 
discuss  Sn,  we  always  assume  that  n  >  No  without  further  mention  in  this  paper. 

Note  that  W(x)  <  0  if  x  e  (0,&g];  W(x)  >  0  if  x  G  o].  Then  the  conditional 
regret  of  Sn  can  be  expressed  as 


_  roo 

R(G,Sn\Xn)-R(G,S )  =  /  (Sn  -  S)W(x)a(x)dx 

Jo 

ft>G 

=  /  I[wn(x)<0]W  {x)a(x)dx 

Jdn 

0 

+  /  I[Wn(x)>o]\W(x)\a(x)dx 

J  bn 


(2.7) 
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and  the  unconditional  regret  of  Sn  becomes 

f&G 

fdn 


f<>G 

R(G,6n)-R{G,6)  =  /  P{Wn(x)  <  0)W(x)a(x)dx  (2.8) 

Jdn 

+  [  °  P(Wn(x)  >  0)\W(x)\a(x)dx. 

Jbn 


For  G  €  G2,  we  also  propose  another  empirical  Bayes  procedure  Sn  by 


t-  i  1  if  (x  >  0O)  or  {po  <  x  <  90  and  Wn(x)  <  0), 

n  ~  \  0  if  (x  <  b0)  or  (b0  <  x  <  60  and  Wn(x)  >  0). 


(2.9) 


Then  the  unconditional  regret  of  Sn  becomes 

f'bG 

Jb0 


R(G,Sn)  -  R(G,S)  =  [bG  P(Wn(x)  <0)W(x)a(x)dx  (2, 

Jbo 

f°  P(Wn(x)  >  0)|tF(rr)|a(a;)da;. 

JbQ 


10) 


In  the  following  section,  the  convergence  rate  of  unconditional  regret  of  8n  for  every 
G  E  Qi  and  the  uniform  convergence  rate  of  unconditional  regret  of  8n  over  Q2  are 
considered. 


§3  Asymptotic  Optimality  of  8n  and  Sn 


The  convergence  rates  of  Sn  and  5n  depend  on  the  properties  of  W (a;)  and  Wn(x).  The 
more  information  about  W(x)  and  Wn(x)  (including  a(x))  is  used,  the  more  accurate 
rate  we  will  get.  So  firstly,  we  dig  out  a  few  properties  of  Wn(x)  and  W(x).  That  is  a 
few  lemmas,  whose  proofs  are  left  to  §4.  Then  we  state  a  well-known  fact.  Following 
that,  two  theorems  about  asymptotic  optomalities  of  Sn  and  8n  are  given. 

Note  that 

Wn(x)  =  d0an(x )  -  ipn(x)  =  -  Y^V(Xj,x,  n),  (3.1) 

n  3= i 

where,  for  Case  1,  Case  2  and  Case  4, 


V(Xj,x,  n) 


».-!./■(¥)  gjgjg) 

u  a(Xj)  a(Xj)  ’ 


and  for  Case  3  and  Case  5, 


»o-x  gp(^)  K^) 

u  a(X,)  ^  a(X,) 


(3.2) 


(3.3) 


V(Xj,x,n )  = 


Let  W(x,n)  =  E[V(Xj,x, n)]  and  Zjn  =  V(Xj,x,n)  —  W(x,n).  Then  we  have 
Lemma  3.1  W{x,n)  can  be  expressed  as 

W(x ,  n )  =  W(x)  +  urW(x,  n),  (3.4) 

where  x,  n)  is  some  function  such  that  for  all  x  €  [dn  A  bo,  #o]> 

\W(x,n)\  <  ■ BB‘  s  B>-  (3.5) 


Lemma  3.2  For  x  €  [0,#o],  |VF(a:)|  <  2 OqB. 

Lemma  3.3  For  any  fixed  n,  Zjn  are  i.i.d.,  and  for  x  €  [dn  A  bo,  0O],  EZjn  =  0, 

Bl 


and 


E\Z,  '» 


Jjn  | 


a2n  =  EZ]n< 

J  ua*  (a;) 

2(00^1  +  1) 


<  26qB  +  B2  + 


ua*(x) 


where  B3  =  (2 0o  +  1  )Bi\fB,  and 

\  —  f  nain{o(s)  :  x  <  s  <  x  +  u}  for  Cases  1,  2,  4, 

'  1  min{a(s)  :  x  —  u  <  s  <  x}  for  Cases  3,  5. 

Prom  Lemma  3.3,  we  see  that 

P(Wn(x)  >  0)  =  P(-rX=  £  Zj„  >  ")). 

\JnEZ]n  j=i 


and 


P(W„(x)  <  0)  =  P(  7  *  EZj „  <  -F^?W(x,n)). 

\JnEZ^n  j=i 


Based  on  Lemma  3.1,  we  obtain  the  following  useful  result: 
Lemma  3.4  For  x  G  [dn  Abo,  #o], 


W (a:)  >  2B2uT  =>  bP (a;,  n)  >  0  and 


W(  x) 
W(x,n) 


<2, 


(3.6) 


(3.7) 


(3.8) 


(3-9) 


(3.10) 


(3.11) 
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and 


(3.12) 


W(x)  <  -2 B2ur 


W  ( x ,  n)  <  0  and 


W{x) 
W{x,  n) 


<  2. 


Lemma  3.4  allows  us  to  replace  W(x,n)  with  W{x)  in  (3.9)  and  (3.10).  That  makes 
things  a  little  easier  since  we  will  see  that  W  (x)  does  not  depend  on  n  and  has  a  few 
good  properties. 

The  above  four  hold  for  any  G  G  G\  or  (?2.  Note  the  bounds  in  above  lemmas  do  not 
depend  on  G.  So  they  are  the  uniform  bounds  over  Q\  and  Q2.  Next  two  lemmas  give 
the  results  related  to  some  G  G  Gi,  which  will  be  used  only  when  we  consider  Sn. 

Lemma  3.5  For  any  G  G  G\,  there  exist  cGi  and  cG 2  such  that  0  <  cG  1  <  bo  <  cG 2  < 
60 ,  and  for  all  x  G  [cGX,  cG 2], 

\w'(x)\  >  f^y(0o  -  bo)  =  BA,  (3.13) 

for  all  x  <E  [0,  cG\)  U  [cG2,  80], 

|W(*)|  >  W(cG  1)  A  \W(cG2)\  =  BG2.  (3.14) 


Lemma  3.6  For  any  G  G  Gi,  let  UG  =  max{a(x)  :  cGi  <  x  <  cG2 }.  Then  there 
exists  an  integer  Ni(>  No)  such  that  for  n  >  N\, 


r®  0 

/  I[\w(x)\<2B2ur]a{x)dx  <  AB2BGiUGur 

Jdn 


(3.15) 


Let  Lg  =  min{a(rr)  :  ^  <  x  <  cG2  +  e°  2cg2}.  Then  there  exists  an  integer  N2(>  Ni) 
such  that  for  n  >  N\ , 


a*(x) 


>Lg  for  x  G  [cGi,cG2], 

>  r)n  forx  e  [dn,  dn  V  cGi]  U  [cG2, 90]. 


(3.16) 


When  we  consider  the  uniform  rate  of  convergence  of  [R(G,  6n)  —  R(G,  ^)],  we  need 
the  following  two  lemmas. 

Lemma  3.7  For  all  G  G  G2  and  all  x  G  [0  V  (bG  —  £),  (bG  +  ^)  A  60], 

\W'{x)\  >  L,  (3.17) 
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(3.18) 


for  all  G  £  G 2  and  all  x  £  [0, 0  V  (bo  —  £)]  U  [(&g  +  f)  A  6o,  $o] 

\w(x)\  >  14. 


Lemma  3.8  Let  Ua  =  max{a(z)  '■  bo  <  x  <  #o}-  Then  there  exists  an  integer  N i 
such  that  for  all  n>  N  i, 


I[\w(x)\<2B2w]a(x)dx  < 


4  B2Ua 


-u 


(3.19) 


Let  La  =  min{a(a:)  :  ^  <  x  <  do  +  1}.  Then  there  exists  an  integer  N2  >  N\  such 
that  for  all  n>  N2  and  x  €  [6q,  #o] 


a*(x )  >  La>  0. 


(3.20) 


Next  we  state  a  general  well-known  result.  It  is  about  the  non-uniform  estimate  of 
the  distance  between  the  distribution  of  a  sum  of  i.i.d.  random  variables  and  the  normal 
distribution. 


Result  Let  Xi,X2,  •  ■  •  ,Xn  be  i.i.d  random  variables,  EX x  =  0,  EXl  —  o1  >  0, 
E\Xi\3  <  oo.  Then  for  all  x 

\Fn(x)-*(x)\<A- 


s/n(  1  +  |x|)3' 

Here  ^(rr)  is  the  c.d.f.  of  N(0, 1),  Fn(x)  and  p  are  given  by 

f„m  =  p(-1=  £*,<*),  p  = 


"(Ty/nfrt 

Remark  The  above  result  can  be  found  in  Petrov  (1975,  ppl25  Theorem  14)  or 
Michel  (1981).  Here  A  is  independent  of  n.  Michel  proved  A  <  30.54. 


Prom  the  above  result,  we  see  that,  for  any  fixed  n, 
if  x  >  0, 


< 

< 


p{^Xi>x) 

1  -  Fn(x) 

+  A 


1 


1  —  'k  (x)  +  A 


y/n(  1  +  |a:|)3 

EjXil 

^/n\x\a3  ’ 


(3.21) 
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if  x  <  0, 


P(— =  y  Xj  <  x ) 


(3.22) 


-  Fn(x) 

<  ^r(a:)  +  ^4 


<  ^(a;)  +  A 


y/n{  1  +  |rr|)3 

g|x,p 

y/n\x\az' 


Now,  we  prove  our  main  results.  The  first  one  is  related  to  Sn: 

_  1  1  _ 1_ 

Theorem  3.9  Let  u  =  u(n)  =  n~2r+1  for  Cases  1,  2,  3,  5  and  n~^+^en2r  for  Case 
4-  Then  we  have,  for  every  G  €  Gi,  as  n  — ¥  oo,  for  Case  1,  Case  2,  Case  3,  Case  5, 


J.irn^  n2r+1  [R(G,  Sn)  —  R(G,S)]  <  IGBIBqiUg  +  2 BG  <  oo, 


and  for  Case  4, 


where 


rlimjn2r+1en[i?(G,  Sn)  -  R(G,  J)]  <  l§BlBGlUG  +  2 BG  <  oo, 


20oBA(eo)  +  2BgilbJUg  +  2A(290B  +  B2  +  ^f^)A(0o)  for  Cases  1,  5 , 

Bg  =  i  29OBA(0O)  +  2BgilB]Ug  +  2A[(20OB  +  B2)A{9o)\  (260B1  +  1)0O]  for  Cases  2,  3, 

26qB A{9<f)  H - ^lq  ~  F  2A(26qB  +  B2  +  29oB\  +  l)A(^o)  for  Case  4i 

and  amin  =  min{a(:r)  :  0  <  x  <  0O}  >  0  in  Cases  1,  5. 

Proof.  Prom  (2.8), 

R(G,Sn)  -  R(G,S)  =  [  Pn(Wn{x)  <  0)W(x)a(x)I[o<W(X)<2B2w]dx  (3.24) 

Jdn 

r0  o 

+  /  Pn{Wn(x)  >  0) | VP (x)\o(x)I[-2B2ur<W(x)<0]dx 
Jbc 

ft>G 

+  /  Pn(Wn(x)  <  0)W(x)a(x)I[W(X)>2B2Ur]dx 
Jdn 
r0  o 

A  I  Pn {Wn{F)  0)  I VP(^r)  |fl(2?)/[iv(*)<— 2B2uT]dx 

Jbc 

=  I  +  II  +  III  +  IV. 

Part  I  and  Part  II  are  easy  to  handle,  since  we  have  Lemma  3.6.  Using  (3.15),  we  have, 
as  n  >  N\, 

I  <  2B2ur  f  I[o<w(x)<2B2ur]a(x)dx  <  &B\BGiUGv?r ,  (3.25) 

J  dn 


(3.23.1) 


(3.23.2) 
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and 


II  <  2 B2ut  [  I[-2B2uT<w{x)<a]0-{x)dx  <  %BlBG1UGu2r .  (3.26) 

Jbc 

Part  III  and  Part  IV  are  a  little  more  complicated.  We  treat  Part  III  first.  Using  (3.9), 
(3.11)  and  (3.22),  we  have 

III  <  [  °  P(  .  1  =  53  zjn  <  —\Jn(Jn2W (x,  n))I[W(x)>2B2ur]W (x)a(x)dx  (3.27) 

Jdn  y/nEZjn  j=i 

<  f  °  P(-r=T  itZj"  <  (x))I[w(x)>2B2U']W (x)a(x)dx 

Jdn  yj nEZ}n  j=!  2 

fbo  1  / - -  .  .  .  ,  fb<*  AE,|Z7n|3W(:c)a(a;)(Za: 

'«*»  2V  Jdn  ^x\-lyf^W{x)\xal 

rCQlVdn  1  , - 

<  /  tt(-- Jna~2W{x))W{x)a(x)dx 

J  dn  Z 

4-  [  \Er(— \jna^W  {x))W  (x)a{x)dx 

J  cn\  Vdn  2  v 


+ 


C(?lVdn 

24  £|Zjn|3 


/■O, 

■/dn 


n 


a(x)dx 


=  V  +  VI  +  VII. 

Using  (3.6),  (3.16)  and  (3.14),  we  have 

V  <  fCGlVd"  ^-l^^BG2)W(x)a(x)d. 
Jdn  l  t>Z 

Bno  _  rcGiVdn 

=  $(“77F_\/nur?n)  /  W(x)a(x)dx 
Z&Z  Jdn 

<  $(~7^r\/nurln)  [  W(x)a(x)dx 
Zt>  3  J  0 


<  $(- 


Bg  2 
2B3 


\Jnurjn)  x  20o54(0o)- 


Since  y/nurj^  >  logn,  there  exists  an  integer  iV3(>  V2)  such  that  for  n  >  1V3,  $(— f^-^/nwr/n)  < 


b  and 

n 


v  <  2d0BA(d0)  <  2fl0£?A(flo) 


(3.28) 


n 

As  for  Part  VI,  using  (3.6)  and  (3.16),  and  making  change  of  variable  y  =  =4- y/nuLGW  (x), 


we  obtain 


V/  <  [bG  0 (  - -4- Jnua* (x)  W  (x) )  W  (x)  a  (x)dx  (3.29) 

JcGlVdn  2 v 


12 


<  UG$(-^JnuLGW(x))W(x)dx 

JcG\Vdn  2  £>3 

<  -BGiUG  [  $ ( - -4-  JnuLGW(x))W (x) W' (x) dx 

JcG\Vdn  2£)%  V 

AR^R?TT„  1  /■4jV/?niI^W(cG1vdn) 

$(-y)ydy 


< 

< 

< 


LG 

X  — 

nu 

4BG1BjUG 

1 

v  _ 

Lg 

A  - 

nu 

2  BG1BjUG 

1 

x  — 

Lg  nu 

We  consider  VII  in  different  cases.  For  Case  1  and  Case  5, 
2A{290B  +  B2)A{60)  2 A  rbo  290B1  + 1 


VII  < 

< 


nu 


+ 


L 


n  Jdn  ua*(x ) 


a(x)dx  (3.30.1) 


2A(2fl0g  +  ff2)A(fl0)  |  2M^6qBi  +  l),A(flo) 

nu  aminnu 


For  Case  2  and  Case  3, 


VII  < 


2A(26qB  -f-  B2)A(6q )  2A  rbG  29qBi  -t- 1 

nu  n  Jdn  ua(x) 

<  2A(poB  +  g2)A(fl0)  |  2A{29o  +  l)Bi9o 


-a(x)dx  (3.30.2) 


nu 


nu 


For  Case  4, 


VII  < 


< 


2A(290B  +  B2)A(90)  2 A  rbo  2 90B1  +  1 


+ 


s 

Jdn 


nu  n  Jdn  wqn 

2A(290B  +  B2)A(90) 


1 a(x)dx  (3.30.3) 


+  2A(29qBi  +  1)  x  A(9q)  x 


nu  '  ...  nuT]n 

Combining  (3.28),  (3.29)  and  (3.30),  we  get  that  when  n  >  N$, 

Bg  x  A-  for  Cases  1,  2,  3,  5, 


III  < 


{“  nu 

Bg  x  -~r  for  Case  4. 


(3.31) 


TlU7]n 


Now  we  deal  with  IV.  Similar  to  III,  we  get 

r8  o 


IV 


<  f  p(-r==f2Zin  ^  -\]no-2W{x,n))I[w(x)<_2B2Ur]\W(x)\a{x)dx  (3.32) 

Jba  ^JnEZjn  j=\ 

-  L  p(~7 >  ~^\/r^W(x))I[w{x)<_2B2Ur]\W{x)\a(x)dx 

Jba  yf nEZ]nj=i  4 
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reo  1  / - r  ,  ..  .  [e°  AE\Zjn\3\W(x)\a(x)dx 

<  [l-*(-Jna^\W(x)\)]\W(x)\a(x)dx+  ’  J  ;| V ■  - 

Jba  z  Jba  y/n  x  na~2\W (x)|  x  <r3 

<  [  \l-y(l\ft^\W(x)\)]\W{x)\a(x)dx 

JCQ2  " 

CcG2  1  / - 

+  J  [l-y(~2\f^\w(x)\)]\W(x)\a{x)dx 


+ 


*0  2A  ^  £|Z,„|3 


r° o  2/1 

Jba  n 


>bG 

=  VJJJ  +  /X  +  X. 


a(x)dx 


Using  (3.6),  (3.16)  and  (3.14),  we  have 

VIII  <  /',"[l-$(iv^:^BG2)]|H,W|aW<i: 
yCG2  *  £>3 

=  t1  -  ^(^V^n)]  /  |^(x)|a(x)dx 

zr>3  7cG2 

<  l1  “  $(f§VnwM)]  Jb  °  \W(x)\a(x)dx 


'Z 

,Bg2 


<  [1  -  ®(7^~Vnurln)]  x  290BA(90). 

Z&z 

By  the  symmetric  property  of  \&(:r),  for  n  >N3,l-  $(%gy/nuffo)  <  J  and 


yjjl  <  2^oBt4(^o)  <  Bq 


n 


nu 


(3.33) 


Similar  to  VII,  we  obtain 

/*CG2  1  / - 

/X  <  /  [1  -  $(-^=-Vn«o*(*)W’(ar))]|W(»)|a(*)<fa 

Jbo  2B3 

fcG2  I  / - 

<  /  C/G[l-$(-— vWLGIV(x))]|lV(x)|drr 

•'&G  Z.D3 

<  —BgiUg  [CG\l-^-^J^W(x))]\W(x)\W'(x)dx 

Jbn  Z-Dq 


(3.34) 


< 

< 

< 


fbo 

ABqxBIUg 


Lg 

x  — 
nu 

4  BgxBIUg 

1 

v  _ 

Lg 

A  - 

nu 

2  BGxB\Ug 

1 

v  _ 

Lg 

A  - 

nu 

^V^lE\w(CG2)\ 


[1  -  <f>(y)]ydy 


We  consider  Part  VII  in  different  cases.  Obviously,  for  Case  1  and  Case  5, 
2A(290B  +  B2)A(90)  2A  r»o  20o£i  +  1 


X  < 


nu 


+ 


za  r 
n  Jb, 


bG  ua*(x ) 


-a(x)dx 


(3.35.1) 
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<  2Aj2dpB  +  B2)A(60)  |  2A(26qB1  +  1)A{0o) 

UU  G'min'ft''U' 

where  amin  =  min{a(a;)  :  0  <  x  <  #0}.  For  Case  2  and  Case  3, 

X  <  +  B^yM^p)  +  2 A  re°  26pBi  +  1  a/x\^x 

~  nu  n  JbG  ua(x) 

o  Atna.u  _i_  n.\  a(q.\  o  a(oq.  n,  _l  I'm. 


nu,  it  j  oq  u,u,\ju  j 

<  2A(290B  +  B2)A(e0)  |  2A(20oB1  +  l)Oo 

~  nu  nu 


(3.35.2) 


For  Case  4, 


x  <  2Aj2$pB  +  B^jAjd q)  2A  r« «  2^^  +  1 

nu  n  Jbn  un„ 


a(x)dx 


(3.35.3) 


n  Ac  UTjn 

<  +  +  2A(20o5i  +  1)  x  A(9 0)  x  . 

nu  nurjn 

Combining  (3.33),  (3.34)  and  (3.35),  we  get  that  when  n  >  N3, 

"4%:^  !zccZ?i’2'3'5’  <**> 

From  (3.25),  (3.26),  (3.31)  and  (3.36),  we  get,  for  n  >  N3 , 

7?^  a  \  Tf(r  x\<r  I  1QB2BgiUg  x  u2r  +  2 Ba  x  ^  for  Cases  1,  2,  3,  5, 

fl(G.  <S)  <  |  16B2BmUc  x  +  2Bc  x  _L.  for  Case  4, 


„„„  for  Case  4, 

nur\n  5 

For  Cases  1,  2,  3,  5,  u  =  n-5^.  So  u2r  —  —  =  n-5^1,  and 

'  7  J  7  TIU  ' 

jlimjn^Ti[i?(G,(5n)  —  R(G ,  5)]  <  1QB\BGiUg  +  223, 

1  1_  2r  +  l 

For  Case  4,  we  have  u  —  n~^+^en  2r ,  r]n  —  en2r  .  So  u2r 


(3.37) 


'G  <  OO. 


-l—  —  n  ar+ie  1  and 

nurjn  n  > 

lim  n*z+ien[R(G,  Sn)  -  i?(G,<S)l  <  16B%BGiUg  +  2 Bc 

n— kx>  1 

The  proof  is  completed. 


?g  <  oo. 


Next,  we  consider  the  uniform  rate  of  convergence  of  R(G,Sn)  —  R(G,8). 

Theorem  3.10  Take  un  =  n~^+^.  Then  we  have,  as  n  -4  oo,  for  Case  1,  Case  2, 
Case  3,  Case  4,  Case  5, 

lim  n^+ i  sup  [R(G,Sn]  -  R(G,  5)]  <  +  2 Ba  <  oo.  (3.38) 

n-too  G€G2  L 


15 


Proof.  In  this  proof,  let  cg,  =  0  V  (bo  -  0>  CG2  =  (&g  +  0  A  0o.  For  any  G  G  G,  like 
(3.24),  we  have 

R(G,6n)  —  R(G,S)  =  f  Pn(Wn(x)  <  0)W(x)a(x)I[O<w(x)<2B2ur]dx  (3.39) 

Jbo 

r^o 

+  /  Pn{Wn{x)  >  0)\W(x)\a(x)I[_2B2ur<W(x)<0]dx 
Jbc 
r^G 

+  /  Pn{Wn(x)  <  0)W(x)a(x)I[W(x)>2B2ur]dx 

Jbo 

rOo 

I  Pn{\V n{p^)  >  0)  |  W |fl(^)/[Wr(rr)<~2B2Wr]^^' 

Jbo 

=  I  +  II  +  III  +  IV. 

Using  (3.19),  we  have,  as  n>  Ni, 


I  <  2  B2ur 

fb°  t  <  U  /  8BfJ7a  2r 

/  V[o<iy(*)<2B2u>-]a(z)cte  <  u  , 

Jbo  L 

and 

II  <  2 B2ur 

fe°  T  /  X  .  /  8^2  C/a  2r 

/  «*[— 2B2Wr<VVr(a:)<0]^'(^')^^  ^  r  ^ 

Similar  to  (3.27) 

1,1 2  L 

cgiV60  1  j - 

^(--s/na~2W(x))W(x)a(x)dx 

0  ^ 

+ 

[  ^{—\\lna~2W{x))W{x)a{x)dx 

JcGiVbo  2  v 

fbc  2 A  E\Zjn\3  ,  ,  J 
+  /  —  x  1  f  a(x)d: 

Jbo  n 

=  V  +  VI  +  VII. 


Consider  Part  V  first.  If  bo  <  Cq i, 


fCGlVbo  1  -Ay  Tj 

V  <  I  ^(--^i^-~L^)W{x)a(x)dx 

Jbo  2 

L£  / -  fCGiVbo 

=  H-7ntJnuLa)  /  W(x)a(x)dx 

Jbo 

<  *(-#«  f  W(x)a(x)dx 

iBo  v  vo 

<  ~La)260BA(e0 ). 

Id  2, 


(3.40) 

(3.41) 
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Since  \prmLa  >  logn,  there  exists  an  integer  N3(>  N2)  such  that  for  n  >  JV3,  $(- 
n  and 

V  <  —A(00). 
n 

Now  consider  VI. 

VI  <  [  $ ( — — j—  J ~mia* (x) W(x) ) W (x ) a(x)dx  (3.43) 

J CniVbn  2B3  V 


<  Ua  [ bG  ®{-^J^LaW{x))W{x)dx 

JcaxVbo  2 B3  v 

<  -L~lUa  fb°  ^(-7^—JnuLaW(x))W(x)W'(x)dx 

JcaiVbo  2 B3  v 


< 

< 

< 


/c<jiV6o  A-D3 

BlUa  1  f2^V^W(cGlVbo) 


X 


L 


LLa  nu  Jo 
4 B\Ua  .  .  1  f°° 
LL, 

2B%Ua 


§(-y)ydy 


( J  1  r°° 

-X  —  /  $(-y)ydy 

'd  TIU  J  0 


X 


LLa  nu 
For  VII,  using  (3.7)  and  (3.20),  we  have 

VII  <  “(J*i>  +  B2)A(h)  x  i  +  x  -L. 

n  n  La  nu 

Combining  (3.42),  (3.43)  and  (3.44),  we  get  that  when  n>  N3, 

1 


III  <Bax 


nu 


where 

Ba  =  290BA(90 )  + 
Similarly,  we  have 


Xyi^a  Lia 


IV  <Bax 

nu 


From  (3.40),  (3.41),  (3.44)  and  (3.45),  we  get,  for  n  >  N3, 

R(G,  Sn)  -  R{G ,  5)  <  x  u2r  +  2Bax  — 

L  nu 


Since  u  =  n  2r+1 ,  u2r  =  ^  =  n  2r+1 .  When  n  >  ./V3, 


n^+i  sup  [i?(G,  5n)  -  i?(G,(5)]  < 


1 6B2Ua 
L 


+  2  Ba. 


2Bzy/nULQ)  < 

(3.42) 


(3.44) 


(3.45) 
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This  completes  the  proof. 


Remark  For  Case  1,  b0  =  0.  Since  (1.10)  implies  bo  >  b0  =  0,  we  have 
Q2  =  {G  :  G  satisfies  (1.10)  and  (1.11),  min  |W/(:r)|  >  L}. 

xeNbo(t) 


Theorem  3.10  tells  us  that 


16B%Ua 


lim  n2r+!  sup  [R(G,  Sn)  —  R(G,  5)]  < - - — -  +  2 Ba, 

n->oo  G€g2  l 

which  is  a  result  obtained  by  Karunamuni(1999).  But  we  do  not  require  in  Q2  that  be 
falls  in  [0,  po],  where  p0  <  0o  is  a  known  constant. 


§  4  Proofs  of  Lemmas 

Proof  of  Lemma  3.1  From  their  definitions,  oeG(x)  and  i)G{x)  are  monotone  func¬ 
tions.  Thus  aG(x)  <  00  and  1 1>g(x)  <  00  for  x  >  0  by  (1.4)  and  (1.5).  Since  0^(0)  <  B 
from  (1.11),  aG(0)  <  00,  and  ipG(0)  <  fj  +  ff°  ^dG(0)  <  c*G(0)  +  V»c(l)  <  00. 
So  we  have  aG(x )  <  00  and  ipG(x)  <  00  for  all  x  >  0.  Note  that 


r  mj  r  t  r°°  t  dG (*) 

L  aa{s)ds  =  L  I[oi)L 

r,  ID-  r/Gw 

-  yo  1  !•>,](«  z)  Me) 

r  dG(D) 


r  dG(0) 

=  L  {e-x)im 

=  ipG(x)  -  xaG(x). 


Then 


roo 

W (x)  =  (0O  -  x)aG(x )  -  J  aG(s)ds. 


In  Cases  1,  2,  4.  Using  Taylor’s  Theorem,  (2.1)  and  (2.2),  a  straight-forward  computation 
shows  that 

(4-2) 

ua{Xj) 


,°°  roo  #0(^)  a(p) 

Jo  Jo  ua(y)  A{6 ) 

n00  1  ,v  —  x, 

-Ml — - 

u  u  / 


I[o<y<e}dydG(0) 


lKo{1Lr)WlI^dvdG{e) 
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=  r  -K„^— -)ao(y)dy 
Jo  u  u 

=  f  Ko(t)aG(x  +  ut)dt 

J  0 

=  J  Ko(t)aa(x)dt  +  J  Ka(t)utoiQ\x)dt  -\ - f  J  K0(t)— J-oJg(x  +  ut{)dt 

=  cxg(x)  +  ur  x  i  [  Ko(t)tr ocg(x  +  utl)dt, 
r!  Jo 

where  0  <  t\  <  1.  Also, 


KA^-) 

El^nrr] 

a(Xj) 

r°°  r  Kii*?)  <v) 


(4.3) 


f°°  r°°  m  r  ^r(ft\ 

Jo  Jo  a(y )  A(0)I[o<y<d]dydG ^ 


=  C  C  K^mA<»<‘'dvdG{e) 


u  'A{oy 


nOO  7/  _  Of 

K1(^—)aG(y)dy 

-  r  °o(s)ds}\%x  +  U°°[r aa(s)ds]K0(y—)dy 

U  Jy  *  U  JO  Jy  U 

poo  poo 

=  /  K0(t)[  aG(s)ds]dt 

JO  Jx-\-ut 

poo  poo  poo 

=  J  [J  OiG{s)ds]dt  +  j  K0(t)aG(t)utdt  H —  • 


+ 


poo 

/  tfo(f) 
Jo 


ur+1tr+1 
(r  +  1)! 


oJg(x  +  ut^jdt 


poo  utr+1  (  \ 

=  /  aG(s)ds  +  uT  x  - — rr  /  K0(t)at£ \x  +  ut*2)dt, 

Jx  (r  +  lj!  Jo 


where  0  <  t\  <  1.  Let 


W(xtn)  =  —  -  —  J  tr+1K0(t)ocQ(x  +  ut\)dt  (4.4) 

~  (r  +  1)!  So  ^lKo(t)aP(x  +  vt2)dt- 


By  (3.2),  (4.1),  (4.3)  and  (4.4),  we  have 

W(x,  n )  =  W(x)  +  urW(x,  n). 

Since  a^H^)  <  B  for  x  E  [O,0o+1],  x+ut\  <  6q+1  and  x+ut\  <  0o+l  fora;  E  [ dnAbo,0o ], 

\W(x,n)\  <  =  ft, 


(r  +  1)! 


(r  +  2)! 
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for  x  €  [dn  A  bo,0o].  For  Cases  3,  5,  the  similar  computation  shows  that 

W{x,n)  =  W(x)  +  urW(x,n), 
and  |W(x,n)|  <  B2  for  x  €  [dn  A  b0,90]. 

Proof  of  Lemma  3.2  By  (1.10),  V’g(O)  <  0o«g(O)  <  90B.  Thus  ipG(x)  <  9qB  for 
x  G  [0, #o]-  Then  we  have 

|VF(rc)|  =  \0oaG{x)  -  4>g{x)\ 

<  90aG(x)  +  ipG(x) 

<  90aG( 0)  +  V’g(O) 

^  2 9qB . 


Proof  of  Lemma  3.3  Obviously,  Zjn  are  i.i.d.  for  fixed  n.  A  few  computations 
show  that,  for  Cases  1,  2,  4, 


<  =  EZ]n 

<  E[V(Xj,x,n)]2 

=  r-^[(60-x)K0{?—Z  )-uK1(^—^  )}2aG(x)dy 

Jo  u2a(y)  u  u 

=  /  w'A  [(*0  -  g)Ko(t)  -  tfATi(t)]2QG(o:  +  «<)<** 

<  -^(2^1 +  Pi)2. 
ua*(x) 

Then  (3.6)  is  proved.  And  also, 

|Z,„|  = 

J  y>0  u  o(y)  o(y) 

=  -  *>*•<»>  -  «*«(*)] +  I^WI + 

<  2e°^1+2P  +  52. 

«a*  (rr) 

For  Cases  3,  5,  the  proof  is  similar.  We  omit  it  here. 


Proof  of  Lemma  3.4  From  Lemma  3.1,  \W{x,  n)|  <  B2  for  all  x  6  [dn  A  ^o]-  If 
W{x)  >  2B2ur, 

u~rW(x,  n)  =  u~r[W(x )  +  uT W(x,  n)]  =  v,-rW(x)  +  W(x,  n)  >  2B2  -  B2  =  B2  >  0 
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and 

Wjx)  _  u^Wjx) 

W(x,  n)  u~rW(x)  +  urW(x,n) 
u^Wjx)  -  2 ff2  +  W2 
u~rW  ( x )  —  22?2  ~f"  B2 
<  2. 

Then  (3.14)  is  proved.  (3.15)  can  be  proved  in  a  similar  way. 


Proof  of  Lemma  3.5  From  (1.11),  we  know  G'(x)  =  g(x)  exists.  Then 

w'^=W){x-eo)- 

Thus  we  have  W'(x)  <  0  for  x  <  do.  By  (1.12),  we  know  W'(bG)  <  0.  Since  W'(x )  is 
continuous  by  (1.11),  we  can  choose  cGi  and  cG 2  such  that  cG  1  <  bG  <  cG2  <  #0  and  for 
all  x  €  [cGi,cG2], 

-W(.)  >  .  Bq\. 

On  the  other  side,  let  BG2  =  min{W(cGi),  |PF(cG2) |}-  We  have 

\W(x)\  >  BG2. 


Proof  of  Lemma  3.6  Since  ur  -4  0  as  n  — >  00.  There  exists  an  integer  Ni(>  N0) 
such  that  for  all  n  >  Nx , 

2  B2ut  <  BG2. 

Then  |W(:c)|  <  2 B2ur  implies  x  €  [cGi,cG2]-  So,  using  change  of  variable  y  =  ,  we 

have 


I[\w(x)\<2B2ur]a(x)dx 


< 


< 

< 


rCG2 

I  I[\W(x)\<2B2Ur]Q'(%')dx 

■'CGI 

fCG2 

UGBG1  /  (x))dx 

J  CGI 

2 UoBaBrf  fw\Z  lw<ndy 


4iB2BGiUGur . 


(3.11)  is  proved.  As  for  (3.12),  we  take  N2(>  Ni)  such  that  u  <  A  e°~2Cg2  and 
V n  <  min{a(x)  :  0  <  x  <  0O}  for  cases  1,  3,  5.  For  x  >  dn,  by  our  definition  of  dn, 
a*(x)  >  Tjn  for  Cases  2,  4  and  a*(x )  >  min{a(z)  :  0  <  x  <  60}  >  r}n  for  Cases  1,  3,  5. 
For  x  e  [Cgi,  Cg 2],  we  have  <  x  -  u  <  x  +  u  <  CG2  +  ^~2Cg2 .  Thus  a*(x )  >  LG. 
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Proof  of  Lemma  3.7  (3.17)  is  from  the  definition  of  Q2.  We  prove  (3.18)  here.  If 
bg  —  £  >  0,  for  x  G  [0,  bg  —  £],  by  the  mean  value  theorem 

W(bG-Z)-W(bg)  =  -W'(x*)S, 

where  re*  G  [bg-£,bg].  Note  that  W(bG)  =  0  and  |W'(rr)|  >  L.  Thus  |W(6G-£)|  >  ££• 
If  bg  +  Z  <  do,  W(bG  +  £)  -  W(bg)  =  W'(x**4,  where  rr**  G  [l bg,bG  +  £].  Thus 
I  W(bG  +  01  >  14.  So  for  XG[0,0V  (bG  -  £)]  U  [(bG  +  £)  A  do,  d0],  |W(rr)|  >  L£. 


Proof  of  Lemma  3.8 

Since  ur  —>■  0  as  n  — >  oo.  There  exists  an  integer  TV  i  such  that  for  all  n  >  TV  i, 

2 B2ur  <  14. 

Then  |W(rr)|  <  2 B2ur  implies  rr  G  [0V(&g  —  £),  (&g+£)A0o]-  So,  using  change  of  variable 

V  =  we  have 

r(bG+O^Q  0 

/  I[\W(x)\<2B2ur]a{x)dx 

J0V(bG~t) 

f(bG+0  A^o 

UaL  /  I[\W(x)\<2B2ur][-W  ( x)\dx 

J0V(bG—O 

orr  R  q  r  Yfigzfll 

ZUat>2U  f  2  B2ur 

7  Jw«bn+o Ae0)  h\y\<i]dy 

U  J  2B2ur 

±B2Ua  r 

~irU- 

We  prove  (3.20)  for  different  cases.  For  Case  1,  60  =  0,  a*(rr)  >  La.  For  Cases  2,  3,  4,  5, 
we  can  find  TV2(>  TVi)  such  that  u  <  ^  A 1.  For  rr  G  [&o.  $o]>  ^  <rr  —  w<rr  +  «<0o  +  l* 
Thus  a*(rr)  >  La. 


r&o 

/  T’[|M/(a;)|<2B2U»-]0(^)rf2:  = 

J  0 


< 


< 


< 
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